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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1 .17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.1 14, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.1 14. Applicant's submission filed on 8/10/09 has been entered. 

2. Applicant's submission filed 8/10/09, was in response to the 6/9/09 Office action which 
detailed the rejection of claims 1-3, 5, 8-13, 16-19, 21, and 23-25. Claims 1 and 19 have been 
amended. Claims 1-3, 5, 8-13, 16-19, 21, and 23-25 remain pending in the application and have 
been fully considered by the examiner. 



Response to Arguments/Amendments 

3. Applicant's arguments filed 8/10/09 have been fully considered but they are not 
persuasive. 

4. Initially, it is noted that on page 7 filed 8/10/09, Applicants suggest that the 6/9/09 Final 
Office Action relies upon prior art of record Strahorn to teach the output of information 
corresponding to graphical elements. While Strahorn does appear to teach this, prior art of 
record Jennings was in fact relied upon to disclose this limitation. See top of page 7 of the 
6/9/09 Office Action (e.g. see Jennings column 7 lines 32-34). 

5. On page 7 filed 8/10/09, Applicants essentially argue that prior art of record Strahorn, 
provides help content from a server, not from a parser. However, Strahorn provides help 
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information based not only on information from a server, but also based upon the context related 
to a graphical selection. See Strahorn column 4 lines 38-42. Furthermore, it is noted that 
Strahorn was not relied upon to teach the output of a parser. Rather, Jennings discloses the 
output of information by a parser. See at least Jennings column 7 lines 32-34. Since the 
rejections are based on the combination of references, and not Strahorn alone, Applicants' 
argument is not persuasive. 

Claim Rejections - 35 USC § 103 

6. The following is a quotation of 35 U.S. C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth 
in section 102 of this title, if the differences between the subject matter sought to be patented and the prior 
art are such that the subject matter as a whole would have been obvious at the time the invention was made 
to a person having ordinary skill in the art to which said subject matter pertains. Patentability shall not be 
negatived by the manner in which the invention was made. 

7. Claims 1-3, 5, 8-13, 16-19,21, and 23-25 are rejected under 35 U.S. C. 103(a) as being 
unpatentable over US Patent No. 6,717,593 to Jennings (hereinafter "Jennings"), in view of U.S. 
Patent Application Publication US 20020104068 Al by Barrett et al. ("Barrett") in view of 
"Compilers: Principles, Techniques, and Tools" by Aho et al. (hereinafter "Aho") in view of 
U.S. Patent 5,933,140 to Strahorn et al. (hereinafter "Strahorn"). 

In regard to claim 1 , Jennings teaches that the interactor parses the description 
documents of an interface into elements and reflects them in the object model to form an 
instance representing the interface, downloads the objects corresponding to the reflected 
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elements, registers their interfaces in the object model instance to make them accessible 

by the elements, and invokes execution of each downloaded object with the 

corresponding element to render the element. (E.g. see Abstract and associated text). 

Jennings further discloses the standard use of XML as including utilization, by web 

programmers, of a Document Object Model (DOM) to "create and build XML 

documents, navigate their structure, and add, modify, or delete elements and content" 

(see column 5 lines 30-50). Jennings discloses defining a user interface in terms of an 

object model using XML (see column 5 lines 52-55). Jennings discloses a method for 

identifying user interface (UI) objects in a markup-language stream, the method 

comprising the steps of: 

receiving, from a server and at a computer system, a web-based application for 

display in a web browser, the web-based application comprising one or more web pages; 

See Fig. 2, and column 4 lines 35-47 and 60-61 : 

FIG. 2 shows a communications system that implements a second illustrative example of 
the invention. The system comprises one or more servers 210 and one or more clients 
200 interconnected by a communications network 208. Network 208 is illustratively the 
Internet or the World Wide Web, and communications between clients 200 and server 
210 are effected via hypertext transfer protocol (HTTP) transfers 206 through network 
208. Clients 200 are stored-program-controlled machines, such as personal computers, 
workstations, personal digital assistants, or intelligent telephones, each comprising a 
processor 202 and a memory 201 storing data for use and programs for execution by 
processor 202. These programs may include a Web browser. 

Users access applications 120 via clients 200. 
[emphasis added] 

Also see column 7 lines 15-20, e.g. "The received document, expressed in hypertext 
mark-up language (HTML) with JavaScript inserts, is parsed by an HTML parser and 
a JavaScript parser into HTML and JavaScript elements" [emphasis added]. The html 
document is regarded as at least one "web page." 
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receiving a predefined grammar for the web-based application; See column 8 
lines 53-58 for a discussion of an XML parser which parses a document into XML 
elements. Note that a predefined grammar is inherent in such parsing, otherwise the 
parser would not know be able to recognize an XML element. Jennings also implies 
grammars for particular applications. See column 2 lines 53-57. 

...a parser computer program based on the predefined grammar ... E.g. see FIG. 7 
step 401 and associated text, e.g. col. 7:35-65. 

Jennings des not expressly disclose automatically generating a parser computer 
program based on the predefined grammar using an automated parser generator tool. 
However, in an analogous environment, Aho teaches the well known method of using a 
parser generator tool to automatically generate a parser based on a predefined grammar. 
See Section 4.9, especially Fig. 4.55: 
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Fig. 4.55. Creating an input/output translator with Yacc. 



Note that the grammar is represented as the "Yacc specification" and the parser is 
represented as "a.out". It is also noted that Applicant's originally filed specification also 
describes this "well known parser generator" in paragraph 2 on page 10. It would have 
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been obvious to one of ordinary skill in the art at the time the invention was made to use 
Aho's teaching of a parser generator with Jennings parser. One of ordinary skill would 
have been motivated to use a well known tool to facilitate the construction of a parser in 
order to determine if source code is syntactically well formed (See Aho page 159, bullet 
two, and the 1 st paragraph in section 4.9 on page 257). 
Jennings further discloses: 

scanning a document object model (DOM) of the web-based application with the 
parser computer program...; E.g. see FIG. 16 and associated text, e.g. see col. 7:35-52. 
Jennings does not expressly disclose: scanning the DOM to generate tokens. However, 
Barrett discloses generating tokens using a DOM. See at least paragraph [0101]: " After 
tokenization, the following token stream will have been generated from the DOM model 
of FIG. 10. . ." It would have been obvious to one of ordinary skill in the art at the time 
the invention was made to use Jenning's application with Barrett's token generation in 
order to provide a basis for further development of the application as suggested by Barrett 
(see paragraph [0097]). 

parsing <the tokens> with the parser computer program to identify at least one 
graphical element in the web-based application e.g. see col. 7 lines 20-25 and 42-44, also 
see col. 7 lines 29-32: 

The parsers transform the hierarchy of HTML tags in the source document into a form 
that the underlying layout engine requires (the target form). The browser reflects the 
information into an object hierarchy called the document object model (DOM) to create 
instances of DOM class objects that correspond to the elements. The DOM may comprise 
globally available objects as well as user-defined objects (e.g., plug-ins). A portion of an 
illustrative browser's DOM showing objects and their hierarchies is shown in FIG. 15. 
Instantiated objects are given to a layout manager, which uses them to implement 
what is displayed on the screen, including input elements like buttons, radio buttons, 
and text entry, [emphasis added] 
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Note in order to display graphical elements, they must be parsed and identified, otherwise 
a button would be indistinguishable from text entry or other graphical elements. 

outputting, from the parser computer program ... information about position and 
content of the at least one graphical element identified by parsing the tokens in the web- 
based application; and See column 7 lines 32-34: 

Instantiated objects are given to a layout manager, which uses them to implement what is 
displayed on the screen, including input elements like buttons, radio buttons, and text 
entry. 

Note that position and content information are included at least as early as the HTML 
markup, and is provided in the DOM for use by the layout manager. While Jennings does 
not expressly describe this aspect, all html documents are able to provide such 
information as described at least by the description of HTML by W3C, "HTML 4.01 
Specification," e.g. see Chapter 1 1 "Tables." See at least page 20 which describes 
position information (i.e. "valign") for particular content (i.e. table). Note that W3C 
describes inherent characteristics of Jennings' documents, and is not needed as a basis of 
the rejection. 

Jennings, Barret, and Aho do not expressly disclose: to a context-based help 

utility. Further, Jennings, Barret, and Aho do not expressly disclose: providing context 

based help based at least in part on the at least one graphical element in the web-based 

application. However, Strahorn teaches context-based help based upon a particular 

portion of the application. See Fig. 3 and column 3 lines 12-14: 

The user may select portions of the miniaturized depiction, causing the help software to 
display help information specific to the selected portion. 

Also see column 4 lines 38-42: 
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When the user selects a section of depiction 320, for example, using a mouse, program 
312 retrieves help information from server 102 specific to the section selected, and if 
new help information is available, program 312 updates help information section 324. 

In order for Strahorn's program 3 12 to retrieve help information, it must be output from 
the server. In other words, information about the graphical element is output to the 
context-based help utility based on the graphical elements in the web page. It would have 
been obvious to one of ordinary skill in the art at the time the invention was made to use 
Strahorn's context based help with Jennings' parsing of graphical elements in order to 
overcome the limitations of conventional help facilities in a web page as suggested by 
Strahorn (see column 1 lines 50-53). 

As per claim 2, the rejection of claim 1 is incorporated and further Jennings 
teaches: "wherein said markup-language stream drives a markup-language-based 
browser application, and wherein the scanning step includes scanning the DOM 
generated by a browser that displays that application." (E.g. see col. 7:35-52). 

As per claim 3, the rejection of claim 1 is incorporated and further Jennings 
teaches: "wherein the scanning step includes identifying elements of the DOM by 
traversal thereof." (E.g. see FIG. 16 and associated text, e.g. see col. 7:53-57). 

As per claim 5, the rejection of claim 3 is incorporated and further Jennings 
teaches: "wherein the scanning step includes generating one or more tokens for each 
scanned DOM element." (E.g. see col. 7: 7:42-45). 
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As per claim 8, the rejection of claim 1 is incorporated. Jennings further teaches: 
"wherein the at least one UI objects comprises one of a user input field (E.g. see col. 
7:31-32, text entry and see FIG. 15, block "Password" and associated text), a text field 
(E.g. see col. 7:31-32, text entry and see FIG. 15, block "Text" and associated text), a 
metatag (E.g. see FIG. 4 and associated text, e.g. see col. 5:47-50, and col. 7:45-50), 
unprintable markup- language (E.g. see FIG. 15, block "Hidden" and associated text), or 
an in-line image (E.g. col. 7:35-40 and see FIG. 15, block "Image" and associated text)." 

As per claim 9, the rejection of claim 1 is incorporated and further Jennings 
teaches: "wherein the scanning and parsing steps are adapted to identify UI objects that 
correspond to elements displayed in the web-based application." (E.g. see FIG. 16 and 
associated text, e.g. see col. 7:35-52). 

As per claim 10, the rejection of claim 1 is incorporated and further Jennings 
teaches: "grouping the tokens into syntactic structures that identify items displayed by the 
web-based application." (E.g. see col. 7:20-25). 

As per claim 1 1, the rejection of claim 10 is incorporated and further Jennings 
teaches: "wherein said step of grouping comprises identifying similarly formatted 
markup-language elements based on their markup-language attributes such as 
classname, font size, style, tag color, and size." (E.g. see col. 5:17-29, style sheet). 
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As per claim 12, the rejection of claim 1 is incorporated and further Jennings 
teaches: "wherein said at least one object comprises a name (E.g. see col. 6:1-3), content 
(E.g. see col. 6:1-3, value), a shape (E.g. see col. 5:64), or a location (E.g. see col. 6:3- 
5)." 

In regard to claim 13, the above rejection of claim 1 is incorporated. All further 
limitations have been addressed in the above rejection of claim 1. 

In regard to claim 16, the above rejection of claim 1 is incorporated. Jennings 
does not expressly disclose a LALR(l) parser. However, Aho teaches that Yacc is a 
LALR parser. See paragraph 1 in section 4.9 on page 257. 

In regard to claim 17, the above rejection of claim 1 is incorporated. Jennings 
does not expressly disclose a LR(1) parser. However, Aho teaches that Yacc is a LR 
parser. See paragraph 1 on page 216. 

As per claim 18, the rejection of claim 1 is incorporated and further Jennings 
teaches: "wherein the markup language is any of HTML, ..." (E.g. see col. 7:16-20). 

As per Claim 19, Jennings discloses a digital data processing system. See Figure 
2. All further limitations have been addressed in the above rejection of claim 1 . 
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As per claim 21, the rejection of claim 20 is incorporated and is rejected for the 
same reason set forth in connection with the rejection of claim 12. 

As per claim 23, the rejection of claim 19 is incorporated and further Jennings 
teaches: "wherein said tokens are interpreted according to the predefined grammar to 
identify and distinguish among UI objects of the web-based application's display." (E.g. 
see FIG. 16 and associated text, e.g. see col. 7:35-65). 

As per claim 24, the rejection of claim 19 is incorporated and is rejected for the 
same reason set forth in connection with the rejection of claim 8. 

As per claim 25, the rejection of claim 19 is incorporated and is rejected for the 
same reason set forth in connection with the rejection of claim 18. 
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Conclusion 

8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JAMES RUTTEN whose telephone number is (571)272-3703. 
The examiner can normally be reached on M-F 9:00-5:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Tuan Q. Dam can be reached on (571)272-3695. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/J. Derek Rutten/ 

Primary Examiner, Art Unit 2192 



